On a general g-Fourier transformation 
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^ ■ Abstract 

^ . 

', Wiener used the Poisson kernel for the Hermite polynomials to deal with the classical 

O . Fourier transform. Askey, Atakishiyev and Suslov used this approach to obtain a g-Fourier 

i transform by using the continuous g-Hermite polynomials. Rahman and Suslov extended 

^ ■ this result by taking the Askey-Wilson polynomials, considered to be the most general 
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continuous classical orthogonal polynomials. The theory of (/-Fourier transformation is 



^ ■ further extended here by considering a nonsymmetric version of the Poisson kernel with 

■^ ' Askey-Wilson polynomials. This approach enables us to obtain some new results, for 

a ■ 

example, the complex and real orthogonalities of these kernels. 
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1. Introduction. Two of the most frequently used formulas in the area of integral 
transforms are the classical Fourier transform 



oo 



(1-1) fix) = -^ / e'^yg{y)dy: = F[g]{x), 

— CX) 

and the corresponding formal inversion formula 

oo 

(1.2) 9{y) = ^ [ e-^^yf{x)dx: = F-'[f]{y). 

— oo 

There are many excellent references on Fourier transforms (see, for example, Titchmarsh's 
classic book [20]), but, for our purposes the most important reference is Wiener [21], who 
looked at the Fourier transform from the point of view of classical orthogonal polynomials 
on R, in particular, the Hermite polynomials Hn{x). 

An elementary result in non-relativistic Quantum Mechanics is that the normalized 
wavefunction of the Hamiltonian operator for the harmonic oscillator is the Hermite func- 
tion 

(1.3) -^nix) = (2'^n! V^) ~^'^Hr,{x) e^'/^, 

see, for example. Landau and Liftschitz [13, p. 70]. The bilinear generating function (the 
Poisson kernel) for these functions is 



(1.4) Kt(x,y) = ^rvl/„(a:)vl/,(y) 



n=0 



= [Ml-t^)]-V2 



exp 



Axyt- {x"^ + y'^){l + t" 



2(1 -t2) 

which is better known as Mehler's formula, see [19]-[21]. 

We make two important observations. First, the kernel Kt{x,y) as given by the 
function on the right of the second equality in (1.4) has the property 

pixy 
(1.5) \im Kt{x, y) = Ki{x,y) 



t^i ^- '"' ^- '"' V2^' 



which, of course, is the kernel of the integral transform (1.1). In fact, Kt{x, y) is analytic 
everywhere on the unit circle in the complex t-plane except at t = ±1. We shall set 



(1.6) K,r{x,y) = Kt{x,y) 

gi(7r/2-r)/2 

=^ exp 



V2 



TTsmr 



. 2xy — {x"^ + y^) cos r 
2sinr 



i- 



< r < TT, and define a generalized Fourier transform by the formula 

oo 

(1.7) f{x):= / ICr{x,y)g{y)dy. 

— oo 

The corresponding formal inversion formula is 

oo 

(1.8) g{y)= [ ICUx,y)f{x)dx, 



where * indicates the complex conjugate. For a sketch of the proof of (1.8) see [17]. 

The second observation is that the wavefunctions in (1.3) are the eigenfunctions of 
the Fourier operators in (1.1) and (1.7): 

oo 

(1.9) e'^'^^nix) = j lCr{x,y)-^Mdy, 

— oo 

where < r < tt for (1.7) and, r = 7r/2 for (1.1). 

Our primary interest in this paper is a general g-analogue of (1.9) as well as of (1.7). 
As was explained in [17], a g-analogue of a formula contains a parameter q, usually complex 
and \q\ < 1, such that the limit of the new formula as g ^ 1 is the given formula. For 
example, a ^-analogue of a complex number a is (1 — q"')/{l — q) since 

a = iim , 

q^i 1-q 

the branch of q"' chosen here is the one that gives Iim g" = 1. 

There is a great deal of interest these days in g-analogues of important classical for- 
mulas. Sometimes the interest is nothing more than a curiosity, but in view of some recent 
developments in the generalizations of the classical harmonic oscillator problem (see, for 



example, [4,5], [8,9] and [14]) the interest in a g- version of the Fourier transform is much 
more than an academic curiosity. The question appears in a very natural way in the 
(j-oscillator problem. 

As was shown in [2] it is Wiener's treatment of the Fourier integrals that contains the 
key to a meaningful g-extension. Just as the Hermite polynomials are associated with the 
wavefunctions for the harmonic oscillator, the continuous g-Hermite polynomials, 

(1.10) gn(x|g)^V , ['^'f\ ^^(n-2k)0^ X = COS ^, 

are associated with the g-wave functions for the g-harmonic oscillator, namely, 

1/2 



(1.11) ^r.{x\q)=[{q''+^;q)oo/2ny y/po{x) Hr,{x\q), 
where 

oo 

(1.12) poix) = 4^1 -x2 n (l - 2(2a;^ - 1)?'' + q^''), < g < 1. 

k=i 

The g-shifted factorials in (1.10) and (1.11) are defined by 

(a;g)o = l, (a;g)n = (1 -a)(l -ag) ...(1 -ag'^"^), n = l,2, ..., 
(1.13) 

(a;g)oo = lim (a;g)n, \q\ < 1. 

n — >oo 

The g-annihilation operator b and the g-creation operator 6"*" that satisfy the commutation 
rule 

(1.14) bb+-q-^b+b=l 

were introduced explicitly in [8]. They act on the g-wavefunction (1.11) in the following 
manner: 



l-g-"\V^ 

U^ri{X\q) = \ 

(1.15) 



/I -(7""\l/2 



6+*„(x|g) = [ ^_ _^ ) -^n+i{x\q), 
see [2] and [8]. One also has the orthogonality property 

(1.16) / ■^m{x\q)-^n{x\q)dx = 6m,u, 



see, for example, [3] and [10]. The important difference between this formula and the 
corresponding formula for the Hermite functions (1.3), namely, 

oo 

(1.17) / <If^{x)'^r,{x)dx = 5m,n, 

— oo 

is that one is over the finite interval ( — 1,1) while the other is over the whole real line. 
So the use of (1.11) as an analogue of (1.3) has the advantage of orthogonality over a 
finite interval. This automatically ensures completeness of the system {\l/^(x|q')}^05 see 
[19, Thm, 3.1.5]. Furthermore, we need not be tied to the g-analogues of the Hermite 
polynomials only, but can consider other generalizations of these polynomials, e.g., the 
g-ultraspherical [3], the continuous g-Jacobi [6], [15] or even the most general, the Askey- 
Wilson, polynomials [6], all of which are orthogonal on (—1, 1). Following this direction, 
the ideas presented in [2] were extended in [17] to the case of the Askey-Wilson poly- 
nomials using the explicit formula for the Poisson kernel derived in [18]. As in [2] this 
led to a singular integral transformation, thus extending the results corresponding to the 
continuous g-Hermite polynomials. 

The purpose of this paper is to do even more: to apply the ideas of Wiener's treatment 
of the Fourier integrals to the case of a nonsymmetric extension of the Poisson kernel for the 
Askey-Wilson polynomials derived here. This paper is organized as follows. In section 2 we 
introduce the Askey-Wilson polynomials and then state our result for the corresponding 
Poisson kernel in section 3. In sections 4-6 we derive an explicit formula for this kernel 
which reveals the structure of the poles. The orthogonality property of these kernels is 
then proved in sections 7-12. Finally, we introduce a new integral transformation and 
prove its inversion formula in section 13. We close this paper by displaying some special 
cases of the kernel and a continuous orthogonality relation for the simplest of them, in 
section 14. 

2. The Askey-Wilson polynomials. We shall assume that a, 6, c, d and q are real pa- 
rameters such that < q < 1 and max(|a|, |6|, |c|, \d\) < 1. The Askey-Wilson polynomials 
[6] are defined by 

(2.1) pn{x) = pn{x; a, 6, c, d) 

g"", abcdq'^~^j ae*^, ae~ 



4</^3 



a6, ac, ad ' ' 



n = 0, 1, . . . , X = cos 9, < 9 < n. This definition diflFers sfightly from the one given in [6], 
but, for our purposes, this is the more convenient one. The symbol on the right side is the 
r — 3 case of the basic hypergeometric series r+ifpr defined by 



(2.2) 



r+l(Pr 



ai, a2, . . . , ttr+l 
61,62, •••,&r 



; ?, z 



•sr^ (ai, a2, . . . , ar+i', (l)k k 



k=0 



{q,bi,...,br;q)t 



with 

(2.3) 



(ai, a2, . . . , ttm; q)k = ^(aj; q)k, see [10]. 

i=i 



The orthogonahty property satisfied hj Pn{x;a, 6, c, d) is 

"1 



(2.4) 



Pn{x) Pm{x) p{x) dx = 5m,n/K 



(2.5) 

(2.6) 

(2.7) 
and 

(2.8) 

(2.9) 



/lo 



(g, ah, ac, ad, he, hd, cd; q)r_ 



hn — ho 



2T[{ahcd;q) 00 
(1 — ahcdq^'^~^){ahcdq~^ ,ah,ac,ad;q)n _2r 
(1 — ahcdq~^){q, cd, hd, he; q)n 



p[x)= p[x;a,h,c,d) = [I - x ) ' , 

h(x; a, 6, c, d) 



h{x; ai, 02, . . . , ar) =11 h{x; aj). 



h{x; a) = JJ (1 - 2axQ^ + a^g^"). 



n=0 



3. The Poisson kernel and a nonsymmetric extension. The Poisson kernel for the 
Askey-Wilson polynomials is defined by 



(3.1) 
with 

(3.2) 



Pt{x,y) = hoKt{x,y), 



•^^ {1 — ahcdq"^^ ^){ahcdq ^,ah,ac,ad;q)n -2n n 
Kt[x,y) = 2_^ 7^^ 7-^ — T—, r^^^ ^ a t 



n=0 



{1 — ahcdq ^){q,cd,hd,hc;q)^ 
Pn{x; a, 6, c, d) p^iy; a, 6, c, d). 
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The series on the right side of (3.2) converges for |t| < 1 and \x\ < 1, |2/| < 1. In [11], Gasper 
and Rahman found an exphcit representation of Kt{x,y) in the special case ad = be, and 
proved its positivity when a = q^^/^+i/^^ 5 = aq^l'^, c = —qf^/'^+^/^^ d = cq^l"^, a, /3 > —1 
(this corresponds to Askey and Wilson's continuous g-Jacobi polynomials [6]). Rahman 
and Verma [18] found an expression for the most general kernel (without the condition 
ad = be) which was reproduced in [17] since the original expression in [18] has many 
misprints. 

In this paper we shall consider a nonsymmetric extension of the bilinear generating 
function (3.2) by replacing Pniv, a, b, c, d) by Pniv, «, /5, 7, S) such that 

(3.3) 07 = ac, [35 = bd, max(|Q;|, |/3|, I7I, \d\) < 1. 

For ease of notation we shall use the labels A and ^ to refer to the parameter-quartets 
{a,b,c,d) and (a,/3, 7,5), respectively. Thus Hq means the same as ho in (2.5), but 



^^ _ ^ (g, «/3, 07, ad, (3-f, (3d, 7^; q) 



00 
7 



27r{a/3'y6;q)oo 
with similar meanings for h^ and /i^. Also, we shall use the notations 

p^{x) =pn{x;a,b,c,d), 
(3.5) 

Pniy) = Pn{y;a,(3,-f,d), 

and 

(3.6) e = {abcdy/^. 
The extension of (3.1) and (3.2) that we have in mind is 

(3.7) Pt^'^{x,y) = h^K^'^{x,y), 
where 

(3.8) K^'^ix^y) = W)"'E^'^>'(^)Pn(^)- 

n=0 

We shall prove in the following sections that 

(3.9) i^^^(x, y) = k[^^ {x,y)+ k[^^ {x,y) + i^f ^ {x,y), 



where 

(3.10) K[^\x,y) 

{—qte, ajdc/h, ajdd/h, ae'^, e^e~'^/6; q),_ 



= (l-t^) 

oo 



(— t/e, ac, a(i, afie^^ /h, aficde '^/6; g),; 
(e, egi/^, -eQi/2, -e/ad;q)k k 



fc=o '^^' ^^' ~^^^' ^^^A'^)fc 



fe 



E 



(g-'^, -e, arf, ae*"^, ae''"^, a(3e'^ /h, a(3e-'^ /h, a/Scde'''^ /b; q) 



^ ^t 



{q, —adq^ ^ /e^a[3^ad,a/5,al3d/h,a[3c/h,e^e '^^/b;q)e 

y. (1 - dq^^-'/a){dq-ya, q^-'/a(3, bq^-'/a(3c, q-'; qU 
^Q {l-5q-^/a){q,l35,cd,q5/a;q)m 

(Je'"^, (Je"''^, de'\ de''^; q)m (hcq\^ 

■ (qi-^e-'^/a, q^-^e^^/a, hq^-^e-'^ /af5, bq^-^e^^aP; q)m ^^^ 

■ s^7\ — -. — q e , ce ,aqe , —rQ ^ ,caq,^,q,ae 

\ b b ab 

(3.11) Ki'\x,y) 

(e^, —e/ad, t, —te/ad, a(3c/b, a(3d/b, ae*^, e^e~^^ /b; q)oo 
(— e, 6c, t/aii, — e/t, ac, aii, a(3e^^/bj af3cde~'^^ /b; q)oo 

^ {-t,tq^/\-tq^/\t/ad-q)k ^^ 
^ (g, gt2, -te/ad, -qt/e;q)k 

Y^ {-tq-^/t, -e, arf, cte^"^, ae"^"^, a(3e'^ /b, aPe''^ /b, a^cde-'^b; q)t ^ 
y-^ {q, adq^~^ /t, aj3, a5, a/ 5, afic/b, a/3d/b, e^e~*^/6; q)£ 



^ (1 - Sq^^^-^a) {Sq-^a, q^'^aP, bq^-^a^c, q'^; q) 



m 



y 

^Q {l-6q ^/a){q,P6,cd,q6/a]q)^ 

{de''^, de-'"^, de'^ , de''^; q)m ^bcq\^ 

■ ^^i_p^_,^i^^ gi-V-^/a, bq^-^e-^^/af5, bq^-^e'^aP; q)m ^^5 ) 

. ^w, f^qi-ie-^^; ce-'^ dq^e-^', ^g^— e-^^ cdq\ ^■,q,ae 
\ b b ab 

and 

(3.12) K^'\x,y) 

_ (e^, ae-^^ ce''^ , de'^^ al3e^^ /b; q)^ 
{aCj be, cd, a(3, ad/t, bcbtjy, q)oo 
{cte'\ c5te'^h, bcte'"^/-/, bcte-"^/r, q)oo 
(e-2*^, cte^(^+<^)/7, cte^(^-<^)/7; q)^ 



^ (t, -e/arf, -te/ad, bc5t/-f, cte'^^+^^-f, cte'^^'^^ /r, q)k k 

k=0 

oo 
^=0 



(q, qt/ad, cte'^^, cdte'^/'j, bcte'^'^/'j, 6cte-''^/7; q)k 

2 +^/^^ ^^^1-A; /^'i q^ q 



qt , —te/ad, —adq /e' 
(ctQ'=e*(^+'^V7. ctq^e'^'^-'^^h, ae^^ ce^^ rfe^^; g) 



-r 



WtI ^^tg'^"^^tg^— tg^6g-"e-^^5e^'^,5e-^'^;g, ^gV 



\ 7 P7 q;7 

+ idem (^; -^) 






where idem (a; 5) means the same expression as the preceding one with a. and b inter- 
changed (see [10]), with a similar meaning for idem {9;— 9). In (3.10)-(3.12), x = cos9, 
< 9 < TV, y = cos (/), < (j) < TT, and the VF-series are special cases of the very-well-poised 
r+iWr series defined by 



(3.13) 



r+iWrya;bi,b2, . . . ,br-2]q, 



r+lVr 



1 /2 

a, qa ' , 



-qa 



^/2,6i,62, ...,6^_2 



ag/6i, ag/62, • • • , aq/br-2 



;q-:Z 



see [10] for further details. 

Looking at the horrendous expressions in (3.10)-(3.12) one might feel somewhat skep- 
tical about their usefulness but, as we shall see later, the main purpose of these formulas 
is to isolate the poles of K^ '^(x, 2/), as a function of t, which are practically all we need for 
our subsequent analysis. 



4. The g-integral representations. To prove (3.9)-(3.12) we will use, following 
the method of [18], the g-integral representation of the Askey-Wilson polynomials [10, 
Ex. 7.34]: 



(4.1) 



Pnix;a,b,c,d) = [A{9)] 



{be; q)r. 
{ad; g), 



-^""^'/^ {due'^,due-'^,e^u/q;q), 
qeio/d {dau/q,dbu/q,dcu/q;q)^ 



{q/u;q)n 
{t^u/q;q), 



■{adu/q)^ dqU, 



9 



where 



(4.2) A{e)=A{e;a,b,c,d) 



= -i — :r-j — («?, a6, ac, be; q)^h{x] d) p{x; a, 6, c, d), 



and the g-integral is defined by 



f6 fb pa 

f{u) dqU = / f{u) dqU - / f{u) dqU, 
(4.3) - ^° ^° 



/ f{u)dqU = a{l-q)J2fi^QnQ 

•^0 m=0 



for any function / such that the series on the right side of (4.3) converge. 

By using the symmetry property of the Askey-Wilson polynomials (2.1), see [6] and 
[10], and the g-integral representation (4.1), we obtain 

A,M/ ^ _ nin ^^ r'""^' ^ (^^^''' ^^^"''' ^'^/^; ^)- 



(4.4) K^'^{x,y)=B{e,<l)) [ d^u 



{hau/q, bcu/q, bdu/q; q)^ 



1^ ' /^ ('yve^^,'yve-'^,e^v/q;q)^ 

d V 

gei^/7 "^ {iav/q,-f/3v/q,-fdv/q;q) 

6W5 {e'^/q; ad, q/u, q/v; q, bcuvt/q^) , 



where the A and /i parameters are related by (3.3) and, of course, e = abed — a/3'y6. Also, 

(4.5) B~^(9, (p) — ; (Qi Qi ac, ad, cd, a(3, a5, (35; q)oo 

467 

■h{x;b)h{y;'y)p\x)p''{y), 

where p'^(x) = p{x; a, 6, c, d) and p'^{y) = p{y; a, /?, 7, d). 

Crucial to our calculations is the following formula for the qW^ series in (4.4) which 
was obtained in [18]: 

(4.6) qWs (e^/g; ad, q/u, q/v; q, bcuvt/q^) 

- (1 t^) ^~^^^' ^^°° V ^^' ^^''^' -^9^^^ -^jad; q)k k 
{-t/e;q)oo ^ {q,bc,-qte,-qe/t;q)k 



4<P3 



q '=, -e, ad, e^uv/q^ 
-adq^~'^/e, ue^/q, ve^/q 
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+ 



+ 



(e^, -e/ad, t, -te/ad; q)oo ^ {-t, tq^^"^, -tq^^'^, t/ad; q)k k 
{-e,bc,t/ad,-e/t;q)oo ^ {q,qt'^,-te/ad, -qt/e;q)k 

-eq~^ /t, — e, ad, e^uv/q^ 
' ^^^ adq^-^/t,ue'/q,ve'/q ' ^' ^ 

(e^, ad, hctu/q, bctv/q, uve'^/q'^; q)oo 



{be, ad/t, ue'^/q, ve'^/q, hcuvt/q^; q)oo 
^^ {t, —e/ad, —et/ad, hcuvt/q^; q)k ^ 



k=0 



{q, qt/ad, bctu/q, bctv/q; q)k 



4<P3 



q-'', -t, tq^/^, -tq^/^ 
qt^, -et/ad, -adq^'^ / e' ^' '^ 



The contribution of the first term in (4.6) to K^ '^{x, y) is 

(4.7) 

{e,eq^/'^,-eq^/'^,-e/ad;q)k ^ 



{-t/e;q)c 



E 

k=0 



{q,bc,-qte,-qe/t;q)f 



{q ^,-e,ad;q) 



E yq ,-&,»' 



^ „(. 



^=0 



{q,-adq^ ^/e;q)i 



q'Ui, 



where 

(4.8) 



Up 



qe-">/b 



qe^'' /b 



(bue ,bue ,ue q ; g) 
^ 11 — 

"^ {bau/q,bcu/q,bdu/q;q)o 



qe "-"^/-y 



dnV 



(7i)e"^,7t'e '^^,ve'^q^ ^,uve^ /q;q)c 



(4.9) 



qeif'/j {'yau/q,'y(3v/q,'y5v/q,uve'^q^ ^;<?)oo' 

Likewise, the contribution of the second term in (4.6) is 

(e^, —e/ad, t, —te/ad; q)oo 



K[^\x,y)=B{e, 



{-e,bc,t/ad,-e/t;q)^ 
^ (-t,tqy^,-tqy^t/ad;q)k ^. 



fc=0 

oo 



{q,qt'^, -te/ad, -qt/e;q)k 



^^ {-eq ''/t,-e,ad;q)i . 



1=0 



{q,adq^ ^/t;q)i 



FinaUy, the last term on the right side of (4.6) gives 

{e'^,ad;q)^ 



(4.10) 



K[^\x,y)=B{e, 



{be, ad/t; q)^ 
11 



■E 

fc=0 



• 4<P3 



(t, —a I ad, —tt/ad] q)k k 
{q,qt/ad;q)k 

q-^,-t,tq^/^,-tq^/^ 
qt^,-te/ad,-adq^-''/e'^'^ 



Vk. 



where 

(4.11) 



Vk 



rqe-'O/b 






^ {hau/q, bcu/q, bdu/q; q) 



oo 



dqV 



{'jve'^'^.'jve ^'^,hctvq^ ^,uve^ /q^]q)^ 



iqei-t'/'y {'fav / q,'yPv / q,'y6v / q,bcuvtq'' '^•,q)oo' 

5. Computation of Ki^^(x,y) and Kp^(x,y). Using [10, (2.10.19)], we get 



(5.1) 



'^'^ ^'^ {"fve'-'^, 'yve~'"^, ve'^q^~^, uve^/q; q)^ 
q^i4./^ i'jav/q, -if3v/q, 'ySv/q, uve^q^-"^] q), 

q{l-q) 



■ dnV 



{q,a/3,a6,/35]q)ooHy;'y)p'^{y) 

Zt'f 

{ae^'^, ae"**^, afiu/q; q)e 

{a[5,a5,a/5]q)oo 
sWj {Sq-^/a; de'^, de'"^, pdu/q, q^~^/a(3, q'^; q, q^/aSu) 



Substituting (5.1) in (4.8) we get 
q{l-q) 



(5.2) 



Ue 



2^7 



(q, a/3, a6, /36; q)oo Hy; 7) p^(y) 



{ae^^,ae-^'^]q)i 
{af3j adj a/d; q)i. 



E.7T 



(1 - V"" /a)(5Q-7a, 56*"^, 5e-''P, q^-yal3, q'^] q) 



m=0 



(1 - dq-^/a){q, q^-^e'^'l' /a, q^-^e^^la, /35, qbja; q). 



where 



(5.3) 



/--(T)(_/3/5)' 



ge-^Vb 



{bue ,bue ,ue q \a/3u/q]q) 



qe-^^/b 



{bcu/q^bduq^ ^,a(3uq^ "^ ^,abu/q;q) 



dnU 



{q, e^'^, qe-^'^, a^dq^b, aPcq^-'^/b, cdq"^, q^e^e'^^ jb, a^e''^ jb; q)oo 
(ce^^, dq'^e^'^, a^q'^-'^e^'^ /b, ce"^^, dq'^e-^'^, a^q^-'^e-'^^ /b, ae"^^, a^cdq^e-^'^ /b; q), 

8W7 {aPcdq^-^-'^ /b; ce''^ , dq^^e''^, aPq^-'^e''^ /b, cdq\ a(5/ab] q, ae'^) , 
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by [10, (2.10.19)]. Simplifying the coefficients, we obtain from (5.2), (5.3) and (4.5) 
B-\e, (p) {a(3c/b, a/3d/b, ae^^ e'^e-'^b; q)^ 



(5.4) Ue 



{ac,ad,al3e'^^ /b,a(3cde ^^/b;q)oo 
{ae''^, ae-''^, a^e'^b, aPe''^ /b, aPcde''^ /b; q)e 



E 

m=0 



(a/?, ad, a/dj a(3d/b, a(3c/b, e^e *^/6; q)(, 

(1 - dq^'^-^/a){dq-^/a, q^-^/a[5, bq^-^/af5c, q'^; q), 



{1 — 6q ^/a){q, pS,cd,qS/a]q)^ 
{6e'^,Se-'^,de'^,de-'^;q)m 



■{bcq/aSy 



(qi-ee-'^/a, q^-^e'^/a, bq^-^e-^^^ /aP, bq^-^e^^ /af3; q), 
■ sWj {aPcdq^-^e-'^/b; ce''^ , dq^^e''^, aPq^-'^e''^ /b, cdq\ a(5/ab] q, ae'^) . 

Use of (5.4) in (4.7) and (4.9) then gives (3.10) and (3.11). 

6. Computation of K^ (x, y). In order to compute K^ (x,y), we have to express Vk 
of (4.11) in a form that is real in both 9 and (p. First of all, by [10, (2.10.19)] 



(6.1) I{u): 



qe 



-i(p 



'^ {'jve^'^.'-fve '^'^ ,bctvq^ ^,uve^/q;q)c 
q^^4>|^ {lOiv/q, -il3v/q, 'jSv/q, bcuvtq''-'^; q), 

q(l — q) 
= -^r. (?, a/3, ad, (3d; q)oo h{y; 7) p^{y) 

Zl'f 

{bctq^ e~'"^ / ^ , u^e~'"^ l^q; q)oo 



dqV 



%WA^e-' 



•^hq; ae-''^, /^e"^"^, (Je"''^, q/u, adq'^ /t; g, bcutq^'^ e''^ h) . 



Using Bailey's transformation formula [10, (2.10.1)] for a very-well-poised s4>7 series we 
find that 

q{l-q) 



(6.2) I{u) 



2z7 



{q, aS, pS; q) 00 h{y; 'j) p^{y) 



{bctq e^^/'y,bctq e ^^ /'y,a(3u/q,bcSutq /'y;q)oo 
{bcutq^~^ e'^^ / --y , bcutq^~^e~'^'t' /'-y, bcdtq^ /'-y; q)oo 

sWr (bc5tq'^~^ /'j; 5e^'^, ^e"'"^, a5tq^/ad, bctq^'/a'-i, q/u; q, a(3u/q). 



Now we break up the gVFy series in (6.2) into two balanced nonterminating 4(^3 series by 
use of [10, (2.10.10)]: 

(ae"^, ae""^, (36, a(3u/q, bctc^ j^b, bc5utq^~^ / '-y; q)oo 



(6.3) 



I{u) 



4</^3 



(q;/5, bcutq^ ^e*''^/7, bcutq^ ^e *<?^/7; q) 



q6/a, (35, bc5utq^ ^ j^ 
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^,9 



+ idem(a;(J). 



Use of (6.3) in (4.11) now gives 
q{l-q) 



(6.4) 



Vk 



2z7 



{(i](i)ooKy^i)p^{y) 



{ae"P, ae-"P, (35, bctq'^/'yS; q)^ 



{a/6;q). 



^{bctq''/a-f,de"^,de-^^;q)i ^ 



r-ge" 



''>/b 



{q,/36,q6/a;q)e 

{hue^^ , bue~^^, hctuq^~^ , bc6tuq'^^^~^ /'j; q)c 



qeio/h {hcu/q,hcutq^ ^e^^ /^,hcutq^ ^e '^'^ / ^ , (35uq^ ^,q)i 
{al3u/q,5l3u/q;q). 



ClqU 



{abu/q, bdu/q; q) 
+ idem(Q;;5). 

Observe that the two g-integrals on the right side of (6.4) differ only in that a and 6 are 
interchanged. So we need to transform only one of them. By using the definition (4.3) we 
obtain 



(6.5) 



qe-'yb 



{bue^^.bue ^^ ,bctuq^ ^,bc5tuq^^^ ^h^q)^ 



qe^<^ /b {bcu/q,bcutq^ ^e'^'t' /'-y.bcutq^ ^e "^/7,/35ttq'^ ^'■,q)c 
{a(3u/q,5(3u/q]q)oo 
{abu/q,bdu/q]q)oo '^ 

- {q;q)^h{x;b)p {x) 



2ib v--^--v-,".r ^-^ ^cdte'('q''/-f;q)e 
{ctq^e"^, cdtq^e"^ /^, ae~*^, ce~*^, (ie~*^, a/Se''^ /b; q)oo 
{ctq''e^(^+'^y-f, ctq''e^(^-'l'y-f, e'^^^; q)oo 
r^^^fcgi(e+0)/^^ ctq^e^if}-^)/^^ 5(3q^e'^ /b, ae'^ ce^^ de' 
■ ^'^^ [ qe^'^, ctq^e^'^, c5tq''+^ e'^ / -f , a^e'^ /b, 5Pe'^ /b 

- idem {9; -e). 

Using (6.5) and (4.5) in (6.4) we find that 

{ae"^, ae-"^, bet jab, cte'\ c5te'^ h; q)^ 



q,q 



(6.6) 



Vk = B-\e,(t)) 



{ac, ad, cd, a/3, a6, a/ 6; q)oo 

, a(3e''/b; Q)oo(cte-^^+'^V7, cte'^'-"^^ /r, q)k 
(cte^(^+<^)/7, cte^(^-<^)/7; q)^{bct/'yS, cte^'^, cSte^'^/'y; q)k 



(ae-'\ce-'\de- 



^ {bctq^/a-i, 6e'^, de''^ , /36e'^ /b; q)e ^ 



£=0 



(?, q^lot, P6, cdtq'^e^y'j; q)e 

qk(,i{0+^)l^^ ctq^e^i<^-'^^h, pSq^e'*^ /b, ae^^, ce^^, de''^ 
qe^'\ ctq^e'\ cdtq^+^e'^h, a/Se'^b, SPe^^b 



+ idem(6'; — 6*) > + idem(Q;;5). 
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Changing the order of summation one can rewrite the sum over I in (6.6) in the foUowing 
form 



E 



{ctq^'e'^^+^^h, ctq^e^^^-'^^ j-i, ae\ ce*^ de'^; q)i ^ 



1=0 
■ 4</>3 



'bctq''/a-f, de^"^, Se''^ , d^q^e'^/b 



q 



where the 4(^3 function is now balanced. The two 4(^)3 series that arise from (6.6) in this 
way can be combined into a single s4>7 series by [10, III. 36]. Substituting this result in 
(4.10) we get (3.12). 

7. Multiplication law for the kernels. It follows from (2.4), (3.7) and (3.8) that 

(7.1) j P^'^{x,y)P^r^\y,x')p^{y)dy = P^/{x,x'), 

when max(|A|, |/u|, |A'|, |t|, |t'|) < 1, where A = (a, 6, c, d), X' = (a', 6', c', d'), fx = (a,/3,7, 5), 
and |A| < 1 means |a|, |6|, |c|, \d\ are all numerically less than 1. The corresponding formula 
for the kernels K^ '^{x, y) is 



(7.2) 



J K^'^{x,y)K^/^'{y,x')p^{y)dy 

_ 27r{a(3^d;q)cx, 

(<?, a/3, a'j, a6, /?7, /36, 7^; q). 



^x,x' 



^tt' v-^' ^ )• 



In the next sections we will consider an analytic continuation of (7.2) when the param- 
eters t and t' go to the unit circle and tt' approaches 1, in order to obtain the orthogonality 
relation for the kernels K^ '^(x, y). 

8. Computation of Kj^'^(x, y). Setting t = 1 in (3.10) and (3.11) we can see that 
K[^\x,y) = = K[^\x,y). So, from (3.9), (3.12) and (4.10) we find that 



(8.1) 



-A,^ 



K^'^{x,y) = Kl''^{x,y) 



(3), 



B{e, 



{bc]q), 



Vn 



t=i 



However, from (6.4) we have 
q{l-q) 



i.2) 



Vn 



t=l 



2i7 



{q; q) 00 h{y;-f)p''{y) 
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(ae^'^, ae-^-^, fSS, bc/ ^5; q)oo y. jbc/a^, fe^-^, fe"^'^; g)^ ^ 



(a/5;Q), 



^=0 



{q,qS/a,pS;q)i 



qe-^^/b 



{hue , 6we , bc6uq /7, a^u/q; q) 



qe 



.6 1^ [hcue^'t' /"^q^hcue '^'^/'yq, Pduq^ ^,abu/q;q) 



dqU 



^ (..^.e-.^„,,.M;.,. ^ (.M..e;^^-■^;.,. ^. 



(5/a;Q)c 



£=0 



{q,qa/6,al3;q)i 



qe /h 



{hue , hue ,hcauq /^,al3u/q]q) 



qe 



£11, {hcue'^'i'/'jq,hcue ^'t^/'jq,aPuq^ ^ , ahu / q; q) c_ 



dqU 



All of our calculations so far have been done on the basis of only two conditions (3.3) 
connecting the A-and /U-parameters. We shall now impose a third condition: 



(8.3) 



/97 = he. 



This still leaves us with enough freedom to compute K^ '^{x, y) without hitting any singu- 
larities while enabling us to simplify the computations in (8.2) enormously. First observe 
that the ^-dependent terms in both g-integrals in (8.2) cancel out so that right away one 
has a simpler formula 



•4) 



Vn 



t=l 



2z7 



(je* 



{q;q)ooh{y;-f)p^{y) 

{hue^^ , hue~^^ , a^u/q; q)oo 
e/f, {(3ue^^/q, (3ue~'^'f' /q,ahu/q;q)c 



{ae'^,ae-'^,/36,/3/5;q), 
{a/d;q)oo 



3<P2 



dnU 



(p K(,-'i4' 



(5e^^5e-^^a/?,/3/a;Q)oo , 

H 777 ^ 302 



l3/a,6e''P,5e 
qd/a, (3d 

(3/5,ae'^,ae-'^ 
qa/S, a(3 



Q^Q 



;q;q 



By the nonterminating 3(^)2 summation formula [10, 11.24] we can sum the expression inside 
the curly brackets above to get 



(8.5) 



Vn 



t=l 



9(1-9) 

2z7 



(9; 9)oc h{y; 7) p^{y) {ad, Pe't /^e"^'^; q), 



qe 



'/b 



{hue"^ ,hue ''^ ,aPu/q;q)c 



qeie/b {l^ue^'t' / q, I3ue ^'t> / '-j , ahu / q; q) , 
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dnU. 



Because of (3.3) and (8.3), the g-integral in (8.5) can also be evaluated by [10, (2.10.18)]. 
Our final result for the kernel in (8.1) is 
A,^, „A _ {abcd;q)c 



1.6) K^'^{x,y) 



{a/3, ac, ad, be, bd, cd; q)oo 
{ae'^, ae-'^, (3e"^ , Pe'"^ , ce^^ ce''^ , de^\ de''^ , {(3/bf; q). 



{(3ei^+^^/b, (3e'^-'^/b, ^e'^-'^ /b, (3e-'^-'^ /b; q)oo 
where, it has been assumed that \(3\ < \b\. 

We would like to point out that it is possible to derive (8.6) directly from (3.12) by 
using [10, 11.24]. 

9. Relation of K]^''^(x, y) with the continuous q'-Hermite polynomials. The Pois- 
son kernel for the continuous g-Hermite polynomials is, see [3], 



(9.1) Y. Hn{cose\q) Hr^icos cl)\q) j^ 

n=0 y.(l^(l)n 

^ (^'^Q)"° |H<i 

So the right side of (8.6) coincides with it (up to a factor independent of r) if we identify r 
with P/b. The g-Hermite polynomials are orthogonal on the compact interval [—1,1] and 
so are complete in L^[— 1, 1], [19, Thm. 3.1.5]. We also have 

(9.2) hm [ K^J'\x,y)f{y)dy = f{x), a.e., 
for every function / continuous on [—1, 1], where 

(9 3) K(°) ix y) = {qy,e'^'^,e-'^^;qU 

^ ' - y-^^y) 27rsin(/)(re^(^+<^),re^(^-<^),re*(<^-^),re-*(^+'^);Q)oo' 

It also means that in the limit r -^ 1~ the kernel Kr {x, y) behaves like the delta functional 

5{x-y). 

The proof of (9.2) follows by Wiener's arguments in lemma [21, proposition X55, p. 41]. 
Indeed, if we set a = 0, b = -n and Kr{9, (p) = sin (p Kr (cos 6*, cos(/)), then the hypotheses 
of this lemma are satisfied by this kernel. Here 



(9.4) / Kr{9,cl))dcl)=y^j^Hn{cose\q) 

Jo ^o(^;^)- 
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27r ./o 



due to uniform convergence of the series for |r| < 1 and the orthogonahty of the g-Hermite 
polynomials. Thus the property (4.12) of [21] is established. Again, if 9 + (f) > \9 — (/)\ > 
•0 > 0, then 

(n r^ p2i(^ p-2i(f>. „\ 

(9-5) KAe.<p)<^^^S,-^^-^ 



< (constant) 



(re*'^,re '^'^;q) 



2 • 

CO 



Since 



re'('^T^\re-'^'^'^^;q 



J2k\ 



= JJ (1 - 2r cos(0 T (t))q^ + r'^q" 

fc=0 

oo 

> JJ (1 - 2r cos tl)q^ + r'^q^^) = (re^'^, re"^'^; q)^. 

fc=0 

The validity of [21, (4.13)] is thus assured. The positivity of Kr{9,(f)) is also obvious. 
Therefore, by [21, proposition X55] 

(9.6) lim / Kr{e,(P)g{(P)d<l) = g{e), a.e., 

r^l- Jo 

which is equivalent to (9.2). 

10. Complex orthogonality of the kernels. Set t = re^'^.t' = re~*^ with < r < tt 
in eq. (7.2) and consider its limiting form when r — > 1~ and then A' — ^ A. With the aid of 
(8.6), (9.2) and (9.3) we can write (in the distribution sense), for the right side of (7.2): 

(10.1) K^'''{x,x') • Mabcd;qU 



(g, a6, ac, ad, be, bd, cd; q)^ 
d{x — x') 



as A' ^ A. 
p-^{x) 

Here A = (a, 6, c, d), X' = (a', 6', c', d') with ac = a'c' , bd = b'd', be = b'c' and b' < b. 

To consider the analytic continuation of the left side of (7.2) when t = {t')* = re 
e*'^"'^ and k -^ 0"*", let us rewrite this formula in terms of a contour integral (Fig. 1): 

(10.2) I K^^Ux,y)K;-Uy,x')p^{y)dy 

logQ-i f L^;t (^, s) L;;^l(g, z') (Q^^ q-^'; q)^ ds 

C- {aq-', aq-', (3q^, (3q-', -fq', -fq-^, 5q', 5q-'; q)^ ' 
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IT 



where x = ^{q^ + q ^),q^ = e*^; y = \{q^ + q ^), q^ = e^'^ , and L^ '^{z, s) = K^ '^(x, y). 
An examination of the series on the right sides of (3.10)-(3.12) reveals that the poles only 
originate from the function Kl {x,y) given by (3.12). Even here the only singular term 
corresponds to /c = on the right side of (3.12). The poles of the integrand which are 
located in the lower half plane, are given by 

uj + K — iir + 9) 

Si = — , Si + 1,..., 

fl0 3l ^°^^ 

^^"■^^ u: + K-i{T-e) 

S2 = ] ZT : S2 + 1, . . . ; 

logg ^ 
and 

/ — — -y . - J I 

^\ ~ \ Zl 7 '^1 ~ -'-7 



(10.4) 



s'^ 



u' - 


-K-i{T + e') 


u' - 


logg-1 
-K-i{r-e') 



logq ^ 



S'n - 1, 



Here c/7 = e~'^, c'/7 = e~'^ ,r = e~'^ and c < c' < 7. In the limit k ^ 0"*" the first poles 
of (10.4), s'l and s'2, will move from the left half plane to the right plane, thus invalidating 
the formula (10.2). Therefore, we have to replace our original contour C~ by a contour 
C~ with certain indentations (see Fig. 2), thus separating the increasing and decreasing 
sequences of poles (10.3) and (10.4). After the analytic continuation of both sides of (7.2) 
we arrive at the complex orthogonality property of the kernels: 



(10.5) 



logQ-i /• Lll^{z, s) L'^^lUs, z'-){q^', q-^'; qU ds 

2n{a(3'y5;q)c^ 

(q, a/3, a7, a5, (3'y, (35, 7^; q)oo 

2TT{abcd;q)oo d{x — x') 



(g, a6, ac, ad, be, bd, cd; q)oo p{x; a, 6, c, d) 
For the P-kernels, the orthogonality relation (10.5) has the more compact form 

(10.6) / P^-nx. y) P^lUy. x') p^{y) dy = '^^^ ~ f ^ . 

Here C~ — > F^ when y = \{q^ -\- q~^)- 
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11. Real orthogonality of the kernels: the case of one additional mass-point. The 

structure of poles in (10.3) and (10.4) of the integrand in (10.5) was shown in Fig. 2, where 
we now let cu' ^ a; (or d ^ c). First we consider the simplest case when < cu/ logq'"^ < 1 
or 1 < 7/c < q~^ , so only the first pole from each sequence has appeared in the lower half 
s-plane after analytic continuation. Let us denote the integrand on the left side of (10.5) 
as F{z, z' , s). Then 

(11.1) / F{z,z\s)ds= / F{z,z\s)ds 
JC- Jc- 

+ 2ni I Res F{z, z , s) + Res F{z, z , s) J , 

where 



(11.2) ResF{z,z',s) 
In view of (3.9)-(3.12) we get 

(11.3) ResF{z,z\s) 



s=s' s^s' 



lim (s — s'^) F{zj z' J s), ct = 1, 2. 



L\^(^,.)(g2^,g-2-g) 



lim (s-s[)L'^l_)^{s,z'), 



and 



(11.4) lim {s-s[)L':i!lAs,z' 



{e \aq^ ,cq^ ,dq^ ,aq ^1,7"? ^S ^"J ^S'?)c 



logg ^(g, a^e*'^, a7,/97, 57, aii, Q ^^1, g^^'; g) 

{{f3'je~'-'' /cd, aq'""' , abq'''^/(3; q) 
{ab,a/d;q)oo 



3<P2 



13'^e ^'^/ac,dq ^,bdq^^//3 

qd/a, bd ' ^' ^ 



{Pie ^''/ac,dq "" ,bdq''^ /P;q)^ 
{bd,d/a;q)oo 



13'^e '^'^ jcd.aq ^,abq^^/l3_ 
qa/d,ab 



where q^^ = cq^ d'^ ll- We can now sum the expression above by [10, 11.24], thus getting 
the final result 
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(11.5) 

lim (s- s[)LlL^i^{s,z') 

s — >s' 



log q~^ (g, 07, /97, ^7, a6, ati, 6(i, e^*^', 



^ 72e-2^(-+^')/c2;g)^ 

since g^ = e*^ and g^i = ce^'^q^ j'y. The value of i?es F(2, 2',s) is obtained from 

(11.3) and (11.5) by simply replacing Q' by —Q'. Thus we have shown that 

(11-6) y Pll^{x,y)P^^L'l^{y,x')p^{y)dy 

+ / , , , , N — Pjr[cose, cos(r + e +iu)) 
{ao,aa,oa;q)oo 

{ae'^' , be'^' , ce^^' , de^^' , e2^(^+^') "^'^ ; q) ^ 
■ (cie^(r+e')-^^ ^gi(r+e')-^^ ^^t(r+d')-u,^ ^gi(^+e')-c^^ e2^«'; q)c 

+ / , , , , N — P^if [cose, cos(r -e +IUJ)) 
[ab, ad, bd;q) 00 

{ae-'^' , be-'^' , ce''^' , de''^' , e2i(^-e')-2^ . g) ^ 

(Q,^i{T-e')-uj Q^i{T-e')-u} ^^i{T-0')-uj ^Qi{T-0')-uj ^-2i0' 

_50 ' ' ' ' 



^00 



-,6-2'^';^) 



00 



(a; — x') 



Here x = ^(e*^ 



p^{x) 
2(6'^ + e~*^) = cos 6', 7/c = e"^, with 1 < 7/c < q~^ 



12. Real orthogonality of the kernels: the general case. Let us now consider the 
case of more than one pole, say A^ poles, appearing in the lower half s-plane which happens 
when A^ — 1 < uj/\ogq~^ < N, i.e. q^~^ < 7/c < q~^ , since e'^ = 7/c. Here 

(12.1) / F{z,z',s)ds= / F{z,z',s)ds 
Jc~ Jc- 

N-l . . 

+ 27iiy2 [Res F{z,z',s) + Res F{z, z' , s) 

where eqs. (11.2) and (11.3) are still valid but with q^^ = -e^'^q^ ~^ and 5^2 = £e^Tq-z -j ^ 
j = 0,l,...,N-l. So, 

(12.2) lim(s-s;)L^li(s,/) 
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logq~^{q~^; q)j{q, ade^'^ , 017, /37, ^7, ad, ^'^e~'^^'^ q^^~'^^' jc? , q'^^'~^; q)^ 

{{(3'ye~'^'^ /cd, aq^ , aq~^ , dq^ ~^ , abce^'^q^ ~^ / (5^] q)oo 
{ah, a/d] q)c 

/3'ye~'^'^ /ac,dq^ ,dq~^ ^bcde^'^q^ ~^ //S'j 
qd/a, bdj dq^ ~^ 



{bd,d/a]q)oo 
/37e~''^/c(i, aq^ , aq~^ , abce^'^q^ ""'7/57 . 



4<?>3 



qa/d, ab, aq 



2 -J 



q;q 



Both 4(^3 series above are balanced and their coefficients are so matched that the sum in 
the curly brackets can be transformed to a terminating 8(/>7 series by [10, (2.10.10)] which, 
in turn, can be transformed back to a terminating and balanced 4(^)3. The final result is 



(12.3) 



/ \ tH,X 



Iim(s-s;)L^lt(s,/ 



(e, a^e^'^g ^^a'je ^'^q^ ^ /c,l3^e '^'^ q ^ /c, 7 e ^'^ q^ ^ jc.b^e '^'^q^ ^ /c:,q) 
logg-i(g-J; q)j{q, ade'-'^, 0^7, P'j, d'j, ab, ad, bd; q)^ 

{aq""', bq""', cq""' ~^ , dq""' ; q)^ 



(-^2g 2iTg2j 2zy^2^g2z' .^g^^ 

q ■' ,aq ^ ,bq ^ ,dq ^ 



So, from (3.7), (10.5), (12.1) and (12.3) we obtain the following general orthogonality 
property of the kernels: 

(12.4) J P^:^^{x,y)P^lUy,x')p^{y)dy 

[aP, ad, [56, ae'^' ,be'^' ,ce'^' ,de'^' ,e^'^^'+^'^-^^; q)^ 



+ 



{ab, ad, bd, ae^(^+^')-^, /?e^(^+^')-^, ^e*(r+9')-'^, Se^(^'+^')-^, e^^^';q). 



^ ' (/37e-*("+^')/c,Qe-*7a5,ge-^^7c;?)j(?e2--2*(-+^');g)2^. 



E 



^ {q, qe^-'i^+^')/a, Qe^-*(^+^')//3, ge'^-^(^+^')/7, ge'^-i(^+e')/5; q)j 



_^e^(r+OVr,-(^) 



h 



q V2; 4^3 



q ^ ,ae '^ , be '^ , de *^ 



P i'7 (cos 6*, cos(r + 9' + iuj + ij log g) ) 
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+ idem (6''; -6') 
d{x — x') 
p^{x) ' 

where, as before, x = cos 6*, 7/c = e^, g^"-^ < 7/c < q"-^ and 07 = ac, (36 = bd. When 
A^ = 1, the formula above reduces to (11.6). 

13. General nonsymmetric g-Fourier transformation and its inversion formula. 

From (3.7), (3.8) and the orthogonality property (2.4) of the Askey-Wilson polynomials 
one can write 

(13.1) t^ r^ix) = I ^ P,^'^(x, y) r^{y) p^{y) dy, 

where |t| < 1 and r^{x) = h^p^{x), r^{y) = h^p^{y). To consider the analytic contin- 
uation of (13.1) to the unit circle |t| = 1, when t = re^'^ = e*'^"'^, k — > 0"*" and 7 > c, let us 
rewrite this formula in the contour integral form (Fig. 2): 

logQ-i . f L^'''i^^^)rdW + q-n)(q^^q-^'':q) ds 

(13.2) t'^r^(x) = -^^^!—h^ I ^ ^^ ^°° 



* ^ Jc- {ocq'^.aq '',(3q'',(3q ''.'^q'^.'^q ''.Sq^'^dq ^;q)oo' 



where x = cos6,q^ = e*^ and y = cos (j),q^ = e^^. The singular term of L^'^{z,s) = 
K^ '^{x^y) is the k = term of K^ {x,y) in (3.12), and the poles are defined by (10.3). 
Therefore, by analytic continuation, from (13.2) we obtain 



• 1 

-1 



(13.3) e-- r^^{x) = / Pl;^(x, y) r^^{y) p^{y) dy, 

provided that 7 > c. 

To consider the analytic continuation of (13.1) with A and p interchanged, t replaced 
by t' = re~'^'^ = e~^'^~'^ and k -^ O"*", let us rewrite this formula in terms of a contour 
integral (Fig. 3): 

1-1 r L'i;\s,z)T^(\{q^ + q-^))U\q-^^-q) dz 



« ^ Jc- {aq'',aq '',bq'^,bq '',cq'^,cq '^,dq'^,dq ^;q)oo' 

The essential poles of the integrand are now at 

UJ — K — i{T + (/)) 
Z\ = — , ^1 — 1,..., 

(13.5) 

ijj — K — l\T — (p) 
Z2 = -, n 7 Z2 — I,... ■ 

logq ^ 
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In the limit k ^ 0~^ the first poles, zi and Z2, will move from the left half plane to the right 
half plane, thus invalidating the formula (13.4). Therefore, in analogy with section 10, we 
need to replace our contour C~ by a contour C^ with certain indentations (see Fig. 3). 
This gives the analytic continuation of (13.4), and for the kernel P we can write 



(13.6) e-'™r(^(2/)= / Pl^lUy^x) riix) p\x) dx. 



Here C^ -^ T\ when x = ^{q^ + q ^). 

Now we can define a general g-Fourier transformation by 

(13.7) f{x) = j P^.f{x,y)g{y)p^{y)dy:=F,[g]{x), 
and may guess that its inversion formula has the form 

(13.8) g{y)= [ P^ll{y,x) f{x) p\x)dx := F-^[f]{y). 

JTx 

From this point of view, eqs. (13.3) and (13.6) are just mappings, up to a phase factor, 
of two systems of Askey-Wilson polynomials, {p^(a^)} and {p^(?/)}, corresponding to two 
different sets of parameters A = (a, 6, c, d) and n = (a, /3, 7, d) with the conditions 07 = ac 
and (3d = bd. 

To prove the inversion formula (13.8), let us interchange the order of integration in 
the double integral 



dyp''{y)P^^r{x,y) / P^:^l{y,x') f{x') p\x') dx' 
= [ dx'p^'{x')f{x') [ P^^f{x,y)P^lt{y,x')p^{y)dy 

and apply the multiplication law (7.1) for the kernels to get 

(13.9) / dyp^^{y)PX^{x,y) f P^lt{y,x') f{x') p^' {x') dx' 

1 

P^'^'{x,x')f{x')p^'{x')dx'. 
■1 

In the limit A' — » A, under the same conditions as in (10.1), we obtain the inversion formula 
(13.8) for bounded continuous functions. 
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By using the same considerations as in section 12 one can finally obtain the inversion 
formula in terms of a real integral with additional mass points: 

(13.10) 

9{y) = / P!^~t (y, x) f{x) p^{x) dx 

{a(3, ad, (35, ae'^, /Je^"^, -fe''^, Se'^, e2i(^+'^)-2^; q)^ 
{ab, ad, bd, ae^(^+'^)-'^, 6e'(^+'^)-'^, ce^{r+4>)-^^ ^gi(r+<^)-a.^ g2i<^. ^^^ 



(7e^(^-<^), Qe-*^/a5, qe''^ / (3; q)jiqe^^-'^''^^+^^;q)2j 



N-l 

^ {q, ge^-*(^+'^)/a, ge'^-*(^+'^)/6, ge^-*(^+'^)/c, ge^-'(^+'?^)/(i; q)j 

■ /(cos(r + (/) + zcu + zj logij)) 
+ idem {(p; -(p), 

where y — cos^, 7/c = e^ , q^~^ < 7/c < q~^ , and 07 = ac, /35 = bd. 

14. Special cases of the kernel. Although the general form of the kernel K^ '^{x, y) 
given in (3.9)-(3.12) is quite formidable it does expose all its poles which are all that are 
needed for the purposes of this paper. However, in view of its multiplicative property 
(7.2) and its continuous orthogonality when |t| ^ 1 it may be useful to list some special 
cases that correspond to orthogonal polynomials which are lower than the Askey-Wilson 
polynomials in the general scheme of classical orthogonal polynomials. 

Case I. Continuous dual q-Hahn polynomials. Setting d = and 5 = 0, 07 = ac in (3.8) 
one can obtain 

(14.1) 

Kt'''{x,y) 

{ta~ Ypn{x;a,b,c)pn{y;a,(3,'-i) 



00 



Y^ {ab,ac;q)n u^-2^n . 
^0 {Q,bc;q)n 



{a(3, ac, be, acH'^e^^/j'^; q)oo 
(cte^^+^'^/7, cte^^-^'t'/j, cte^'^-*^/7, cte-^^-^'^/7; q)oo 
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k=0 



{t, cte'^+^'P/'y, cte'^-'^/'j, cte'^-'y'y, cte-'^-'^/r, q)k 
(g, c^te^'t' /^^ ate^^, 6cte~*'^/7, Q;cte*^/7, Q;cte~*^/7; 5)^ 

^ . ,^x£ (cte"^'^, bctq''/p-f, acH'^ q^^ e'^ ^"^ ■ q)e 



1=0 



{q.bctq^e ^'t^ /'^.cH'^q^^ /'^'^]q)i 



{ctq^'e'^-'^h, ctq''e-'^-'^/r, q)l 
{actq^e^^ /'-y, actq^e~'^^ /'-y; q)^ 



■ 8 



ac^t 



2+2 



ct 



ct 



at 



cH 



^2 77 7 7 



Q,7e 



Here A = (a, 6, c) and /U = (a, /3, 7), 07 = ac. It would be nice if this formula would follow 
from (3.10)-(3.12) by simply setting (i = 5 = 0, but it doesn't, unless one goes through 
a series of transformations followed by careful use of the limits. We shall give a separate 
proof of (14.1) in the Appendix. 

The polynomials in (14.1) are, of course, the continuous dual g-Hahn polynomials 

g""", ae*^, ae~*^ 



(14.2) 



Pn(a;;a, 6, c) := 3(^)2 



; 9, (I 



ab, ac. 



see, for example, [6], [7] . It is easy to see from (14.1) that in the limit t ^ 1 the kernel 
reduces to 



-A,^ 



(14.3) Kt'^{x,y)= hm K^'^{x,y) 



A,/i / 



t^l- 



(ae'"^, ae-*-^, /^e*"^, /Je"*'^, ce'^ , ce''^ , {c/-ff; q), 



{a(3, ac, be, ce^^+^'^/7, ce^^-^'^j^i, ce*<^-»^/7, ce-*^-*'^/7; q)^ ' 
c 7^ 7, q;7 = ac and (5^ = be, and we can apply the above method to get an inversion 
formula for the corresponding transformation. 

Case II. Al-Salam-Chihara polynomials. The Al-Salam and Chihara polynomials [6], [12] 
may be defined by simply setting c = in (14.2), i.e. 



(14.4) 



Pn{x;a,b) := 3(^)2 



q , ae , ae~ 
ab, 



(be '^■,q)n ( i0^n 



(j~'% ae" 



■,q,qe-^'/b 



26 



So, with A = (a, b) and // = (a, (3), a(3 = ab, we find that 



(14.5) 



^Tzhr-(^'^ '^rPn{x;a,b)pn{y]a,(3) 



n=0 



(9; 9)7 



{ab, aH'^e^^/a, ate^^+^'^/a, ate^^-^-^/a, ate^'t'-'^ / a, ate-'^-''^/a; q), 
iWr {aH'^e'^/aq;t,at/P,ae'^,ate'^+'^/a,ate'^-'^/a; q, be''^) , 



which in the case t = 1 becomes 



X,fi, 



(14.6) K^'^'ix.y) 



{be'% be-'\ ae'^, ae''^, a^/a^; q) 



{ab, ae^+^'t'/a, ae^^-^-^/a, cte^-^-^^/a, ae-'^-''^/a; q)^ 
With a different normalization, namely. 



(14.7) 



Pn(a:^; a, 6) := ,^ , a s(p2 



(9; 9)7 



g ", ae , ae~ 



; ?, ? 



ab, 



the corresponding kernel is 



(14.8) K^'^{x,y):=Y^ 



n=0 



{(mU 

{ab;q), 



rpn{x;a,b)pn{y;a,(3) 



(t^, be-'^, ate'^,l3te'\ ate'"^, ate-'^; q)^ 
~ {ab, at^e^^, te^^+^<^, te»^-»<^, te'^-^^, te"*^-*"^; q)^ 

■ 8W7 {at^q-h'^;at/b,pt/b,ae'^,te'^+'^,te'^-'^; q, be'"'^) 

{Pt/a, ate'\ ate''^ , ate''^, ate-"^; q)^ 
~ {aat, te^^+^'f', te'^-^'t', te^'f'-^^ , te'^^-^'t'; q)^ 

■ gW^r {aatq~^;at/b, ae'^, ae~*^, ae"^, ae""^; q, fit /a) 

with a6 = a[3. Eqs. (14.5) and (14.8) can be derived as a limiting case of (14.1). 

The special case of the polynomials (14.7) are the so-called continuous g-Laguerre 
polynomials. 



(14.9) 



Ll{x\q)=pr.{x;q^'-^^y\q^'-^^y^) 



(see [6]), which go to the classical Laguerre polynomials in the limit q ^ 1, 



(14.10) 



limL«(l-(l-QV2)^|g)=L«(x). 
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From this point of view, one can consider (14.8) as a g-version of the weU-known Poisson 
kernel for the Laguerre polynomials, 



(14.11) Yl 



nl 



-^T{a + n + r 



rL^{x)L^{y) 



n=0 



(1 - r ' exp (-* ^) tor "'^ /„ (2 (f^) 



\t\ < 1, 



where 
(14.12) 



lAz) 



(^/2) 



r(z. + i) 

{z/2r 



e-' iFi (z/ + 1/2; 2z/ + 1; 2z) 



Tiu+1) 

So, one can consider the corresponding transformation with the kernel (14.8) as a g-version 
of the Fourier-Bessel transform. 

Case III. Continuous big q-Hermite polynomials. Setting 6 = in (14.4) one obtains the 
so-called continuous big g-Hermite polynomials [12]: 



(14.13) 



Pn{x;a) := s4>2 



q "", ae , ae~ 



0, 



; 9, Q 






k=0 



The nonsymmetric Poisson kernel for these polynomials can be derived as a limiting case 
of(14.5)by [10, (3.2.11)], 

(ta-2^" 



(14.14) Krix,y):=J2 



n=0 



(9; 9)7 



■ Pn{x; a) pn{y] a) 
{aH^/a'^,ate''^,ae-''^]q)^ 






3<P2 



q, ae 



-icf> 



On the other hand, setting b = (3 = and b/(3 = a/a in (14.7)-(14.8) one obtains the 

kernel 

00 
(14.15) ii:"'"(x,y) := Yr{q;q)nPn{x]a)pniy;a) 

n=0 
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{t\ate"P,ae-'^]q), 



(te^e+icj)^ t(,ie-ict>^ ^gi<^-i9^ ^g-i9-i<^. g^^ 
' at/a, te'^+^'t', te^"^"^^ 



3(P2 



; g, ae 



-icf> 



t^, ate'^ 



Observe that 
(14.16) 



ine V^ (Q ",06^^^), 



lim e'""" V 

n=0 



(9;9)fc 



(-e-^^^)%-(^)=if.(x|,), 



where lin{x\q) is the continuous g-Hermite polynomial defined in (1.10). See also [1] for 
the proof of this limit directly from the first expression in (14.13). Equation (14.15) then 
reduces further to 



(14.17) 



'0,a 



Kt''^{x,y) 



{e,ae-'^-q). 



(te*^+^'^, te^^-^"^, te^"^-*^, te-*^-*"^; q). 



2<A'l 



te 



i9-\-i(f> j-pi(f)—i9 



; g, ae 



-i(f) 



This 2</'i series is related to an addition formula [16] for the g-Bessel functions of Jackson 
[10, Ex. 1.24]. Denoting 



(14.18) 



Jt{x,y) = 2<?^i 



^^iO+i(f) ^^iO—i4 



; g, ae 



we find that a special limiting case of (10.6) is 



(14.19) 



J,.. (x, y) J.V ix\ y)p(y; e'^+'\ e'^-'\ e^' -^^ e"^^ "^^ ) dy 



27r 



.(9;9)c 



5(x — x') 



g2iT^g2ie.g 



(l-x^)^/^ 



where F is a limiting symmetric form of the contour F^ in (10.6). 

We would like to add, in conclusion, that there are many more interesting special and 
limiting cases of the Askey-Wilson polynomials and that the same technique as we have 
developed in this paper can be applied to most of them. 
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15. Appendix: proof of (14.1). The g-integral representation (4.4) in the case of the 
dual g-Hahn polynomials has the simpler form 



:i5.ii 



'A,/i 



Kt^^{x,y)=B^{e, 



qe-^^/h 



qe^'^ /b 



qe 



-i<p 



'^ {bau/q,bcu/q;q)oo 

J (7f^e*'^,7fe~*'^;g)c 
'^ {-iav/q,-i(3v/q;q). 



(l/u, q/v _ be 
2*^^ be ' ^ V 



uvt 



where 

(15.2) 



B^\e, 



— (g, g, ac, afj; g)oo 

■h{x;b)h{y;^)p\x)p^'{y), 



and A = (a, 6, c) and /U = (a,/3,7), aj = ac. The troublesome qW^ function in (4.4) now 
becomes a 2</'i series which is first transformed to a 2</'2 series by 



(15.3) 



2<A'l 



q/u, q/v be 

■ g, —^uvt 



be 






{betu/q, betv/q; g)c 
{be,beuvt/q^;q)oc 



2<A'2 



t, beuvt/q^ 
betu/q, betv/q 



; ?, ^c 



(this formula can be obtained as a consequence of [10, III. 2 and III.4]). So, 



(15.4) 

where 

(15.5) 



Kl^^{x,y) 



ibc;q)oo f-i {q;q)k 



k=0 



Vk 



qe-'^/b 



qe*'^/b 



qe 



-i<p 



{bue^^.bue ^^.betuq'' ;g)oo 
'^ {bau/q,beu/q]q)oo 

''^ (7^6"^, 7t'e~*'^, betvq'^~^;q)c 



dnV 



iqei-pf-y {'jav / q, 'y(3v / q.beuvtq'^ ^;<?)oo' 

The limiting form of the g-integral (6.1) now is 

"1^'^^/^ {'^ve'^, 7t;e-''^, bctvq''-^- q). 



(15.6) 



dqV 



q^i4>/^ i'jav/q.'jPv/q.beuvtq'' '^]q), 

?(l-9)/ o ^ r^t \ ^^t \ {betq^'e-'^/r^q) 
{q,aP;q)ooh{y;'y)p^{y) 



3(P2 



2^7 

ae"**^, /^e"**^, g/w^ beut 
a(3, betq^'e-'^J-f ' ^' ~^ 



{beutq 



k — lp—i(f> 



/r.q)c 



g(l-g) (ae*'^,ae '^.betq'' /-f/3,be/3utq'' ^ /r^q), 

{.q]q)ooh{y]^)p^{y) 



3(P2 



2^7 \-" -"/^ -\^' '/ '- ^"^ (^Q./p^i)cutq'^ ^e^'t' /'^,beutq^ ^e "^/7;g) 
betq^/a-f, Pe''^, Pe'"'^ 



q/3/a, bejSutq /^ 



q, q 



+ idem(a;/3), 
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see also [10, Ex. 3.6] for the last transformation. Therefore, 

(ae^'^,ae-*'^,6ct/7/3;Q)oo 



(15.7) 



-A,^ 



K^'^ix^y) 



{ab,bc,a(3,a/(3]q)oo 

(cte^^+^'^/7, cte^^-^'^/7, e-^^^; q)oo 

y. (t,cfe-^+-V7,cfe-'"^V7;9)fc (^). ^^^fc 
^ (q, 6ct/7/3, cte^, c(5te^/r. g)fc ^ ^ ""^ 

^=0 



4<P3 



(q, Q/?/a,c/3tQ'=e^^/7;Q)£ 



+ idem(6'; — 6*) + idem(Q;; /?). 

Unfortunately, the 4(^)3 series appearing in (15.7) are not balanced and cannot be trans- 
formed in a simple way. By a change of order of summation in the last two series one 
gets 



(15. 



'A, /J, 



i^r(^,y) 



(cte^^ae-^^ce-'^;Q), 



{ac, he, af], cte*^+''^/7, cte^^-^'^/7, e-^^^; g)oo 
^ (ctQ'=e^^+''^/7, ctQ^e'^-*'^/7, ae^^ ce^^g)^ ^ 

^=0 



(g, ge^*^, ctq'^e^^; q)i 



(ae*<P, ae-*<P, bctq''//3-f, /3ctq''+'^e'yr, q) 



k+iA6 



3<P2 



(a//?;Q)oo 

bctq^/a-f, Pe''^, Pe'"'^ 
q(3/a, I3ctq^+^e'^h ' ^' ^ 



+ idem(Q;; (3) 



+ idem(^;-^). 



We can now transform the pairs of 3^2 series above by [10, III. 34], thus getting 

{cte'\ ae-^^ ce'^^ acte'^ h, Pe''^, bcte-''^/r, q)oo 



(15.9) 



K^^(x,2/) 



fc=0 



(ac, 6c, a/3, cte^^+*'^/7, cte*^-*'^/7, e'^^^; q)^ 
((J, cte*^, acte"^^ /'-y, bcte~^'t'/'y; q)k 
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(.=0 



■ 3<P2 



actq'^+^e'^h, hctq^e-'"^ h ' ^' 
+ idem(^;-^). 

We would like to point out that it is possible to obtain (15.9) as a limiting case of (3.12) 
by using [10, (3.2.11)]. 

Changing the order of summation one can rewrite the sum over I in (15.9) in the 
following form 






4<P3 






where the 4(^3 function is now balanced. The two 4(^)3 series that arise from (15.9) in this 
way can be combined into a single 8</'7 series by [10, III. 36]. Substituting this result in 
(15.9) with the aid of [10, III.23] we finally get (14.1). 
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